System and method for managing memory compression transparent to an operating system

ABSTRACT

In a computer system having an operating system and a compressed main memory defining a physical memory and a real memory characterized as an amount of main memory as seen by a processor, and including a compressed memory hardware controller device for controlling processor access to the compressed main memory, there is provided a system and method for managing real memory usage comprising: a compressed memory device driver for receiving real memory usage information from the compressed memory hardware controller, the information including a characterization of the real memory usage state: and, a compression management subsystem for monitoring the memory usage and initiating memory allocation and memory recovery in accordance with the memory usage state, the subsystem including mechanism for adjusting memory usage thresholds for controlling memory state changes. Such a system and method is implemented in software operating such that control of the real memory usage in the computer system is transparent to the operating system.

RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.11/057,083, filed Feb. 11, 2005, now U.S. Pat. No. 7,380,089, issued May27, 2008; which is a continuation of U.S. application Ser. No.09/782,495, filed Feb. 13, 2001, now U.S. Pat. No. 6,877,081, issuedApr. 5, 2005.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates generally to compressed memory systems, and morespecifically, to a software technique for managing and controlling acompressed memory system in a manner transparent to the operatingsystem.

2. Discussion of the Prior Art

In computer systems it is customary that there be one-to-onecorrespondence between the memory address produced by the processor anda specific area in the physical memory of the system. It is an error forthe processor to request access to an address which does not have anassociated physical memory area. This limits the operating system andapplications to an address space determined by the actual physicalmemory installed in the system. Modern computer systems have overcomethis limitation through the use of virtual memory which implements atranslation table (TT) to map program (virtual) addresses to real memoryaddresses.

With virtual memory the program works in an address space limited onlyby the processor architecture. It is a function of the operating systemto ensure that the data and code a program is currently using is in mainmemory and that the translation table can map the virtual address to thereal address correctly. In a virtual memory system the allocation ofmemory is most commonly performed by the operating system software. Thisrequires an interrupt of the instruction sequence so that the privilegedkernel code can allocate physical memory to the area being accessed sothat normal program flow can continue without error. This interrupt andthe kernel processing to allocate physical memory requires a significantamount of processing time and upsets the normal pipelining ofinstructions through the CPU.

There currently exist schemes for reducing operating system processinterruptions. For instance, the reference entitled “Design and Analysisof Internal Organizations for Compressed Random Access Memories” byPeter A. Franaszek and John T. Robinson, IBM Research ReportRC21146(94535), dated Oct. 28, 1998, describes a low level main memorydesign for storing compressed data that includes a directory portion anda collection of fixed size blocks which are used to store lines incompressed format. In the memory storage scheme described hereintherein, highly compressible lines may be stored entirely within adirectory entry; otherwise, the directory entry points to one or more ofthe fixed size blocks which are used to store the line in compressedformat. The system further makes use of page tables which translatevirtual addresses to real addresses which correspond to the location inthe directory of the directory entry for the line and which includesinformation pertaining to blocks holding a compressed line.Specifically, the information in a directory entry includes flags,fragment combining information, and, assuming fixed size entrystructure, pointers to one or more fixed size blocks. On a cache miss,the memory controller and decompression hardware finds the blocksallocated to store the compressed line and dynamically decompresses theline to handle the miss. Similarly, when a new or modified line isstored, the blocks currently allocated to the line are made free (if theline currently resides in the RAM), the line is compressed, and thenstored in the RAM by allocating the required number of blocks.

Furthermore, U.S. Pat. No. 5,761,536 is directed to a memoryorganization technique utilizing a compression control device forstoring variable length objects (compressed memory) in fixed-sizestorage blocks by enabling fixed size storage blocks to receiveremaining portions (leftover compressed memory pieces or fragments) ofvariable length objects that take up less than a full fixed-size storageblock. The system thus reduces memory fragmentation.

U.S. Pat. No. 5,864,859 is directed to a compression store addressingtechnique for storing variable length objects (compressed lines, eachrepresenting, e.g., ¼ of a page) in fixed size blocks so that accessingan individual line may be accomplished quickly and with little change toexisting software. In particular, the beginning of any line within apage may be accessed with a single pointer plus an offset. Associatedwith the compression store is a list of free or available blocks (freelist) which is accessed for enabling variable length object storage.

Commonly-owned, co-pending U.S. patent application Ser. No. 09/627,516entitled DYNAMIC ALLOCATION OF PHYSICAL MEMORY SPACE describes amechanism that enables the physical memory to be dynamically allocatedin a manner such that the interruption in program flow is eliminated.

As the amount of physical memory in a computer is limited due to costand space, operating systems (O/S) have employed techniques that enablemany concurrently running applications to share a common pool ofphysical memory. Above-described co-pending U.S. patent application Ser.No. 09/627,516 further describes a mechanism that facilitates themanagement of memory pools so that the various processes and users sharethe system resources fairly.

In general, current operating systems use a kernel software componentcalled a Virtual Memory Manager (VMM) to provide an illusion of a flat,contiguous memory space equal to the amount of memory that can beaddressed by the processor to running applications. The O/S reserves aportion of the memory space as its own and allows the applications tohave access to the rest of the virtual address space. In reality, theapplications only have a relatively small portion of their address spacein memory and the rest of application data memory is swapped to diskuntil the application makes reference to the swapped memory. The VMMthen swaps in the requested portion of memory.

It follows that in systems with large amounts of physical memory,performance is better since the O/S can allow applications to havelarger segments of data resident in memory, thus reducing the need forswapping to and from disk.

In a system where memory compression is employed, the amount of physicalmemory appears to the O/S to be much greater than is actually installed.The amount of memory presented to the O/S as installed in the computeris called real memory. The ratio of real memory to physical memory iscalled the boot compression ratio of the computer system. As long as thedata that is being contained in the memory remains compressible at arate greater than or equal to boot compression ratio, the system can runcorrectly. However, in the case where the compression ratio of the dataresiding in memory deteriorates to the point of requiring more physicalspace than is available, software components are employed to throttleback the usage of real memory such that there always is enough physicalmemory in which to contain the application and O/S data.

This throttling mechanism may be implemented in one of two ways: 1) bymodifications to the VMM in the O/S kernel itself; or, 2) a package ofsoftware that runs outside of and separate from the O/S.

It would be highly desirable to provide an improved throttling mechanismthat is implemented without modifications to the O/S kernal software andoperates transparent to the O/S.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide in a computer systemhaving a compressed main memory organization, a system and method formanaging memory usage without modifications to the O/S kernal softwareand operates transparent to the O/S.

It is a further object of the present invention to provide in a computersystem having a compressed main memory organization, a system and methodfor throttling back the usage of real memory such that there always isenough physical memory in which to contain the application and O/S data.

Thus, in accordance with the principles of the invention, for a computersystem having an operating system and a compressed main memory defininga physical memory and a real memory characterized as an amount of mainmemory as seen by a processor, and including a compressed memoryhardware controller device for controlling processor access to thecompressed main memory, there is provided a system and method formanaging real memory usage comprising: compressed memory device driverfor receiving real memory usage information from said compressed memoryhardware controller, the information including a characterization ofsaid real memory usage state: and, a compression management subsystemfor monitoring the memory usage and initiating memory allocation andmemory recovery in accordance with the memory usage state, the subsystemincluding mechanism for adjusting memory usage thresholds forcontrolling memory state changes.

Advantageously, such a system and method is implemented in softwareoperating such that control of the real memory usage in the computersystem is transparent to the operating system.

BRIEF DESCRIPTION OF THE DRAWINGS

Further features, aspects and advantages of the apparatus and methods ofthe present invention will become better understood with regard to thefollowing description, appended claims, and accompanying drawings where:

FIG. 1 is a block diagram illustrating the compression managementsoftware architecture according to the invention.

FIGS. 2( a)-2(b) is a flow chart depicting the compressed memorymanagement sub-system algorithm.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention comprises a system and method for throttlingmemory usage in a compressed memory system. FIG. 1 illustrates a blockdiagram detailing a generic operating system employing the compressionmanagement software architecture 10 according to the present invention.Particularly, the compression management software architecture 10 ofFIG. 1 comprises employs two major software components: 1) a DeviceDriver 20; and 2) a Compression Management Service (“CMS”) 50. TheDevice Driver component 20 includes a compressed memory statisticsmodule 24 for monitoring and exporting physical memory usage statisticsand provides other services related to the compressed memory controllerhardware 80. The CMS component 50 is implemented as a high priorityprocess, which monitors real memory usage and the compressibility of thedata contained in the real memory.

With more particularity, the compressed memory controller 80, functionsas follows: First, it provides for transparent address translationbetween the real addresses provided by the CPU and the actual locationsin physical memory; and, second, it additionally provides an L3 (Level3) cache of memory in which frequently accessed pages of memory arestored in an uncompressed format. As referred to herein, the term CTT(Compression Translation Table) represents the data structures used bythe memory controller to perform the address translation. The CTT itselfconsumes some portion of the physical memory of the system and must beaccounted for in managing the memory. This level of indirection betweenthe real and physical addresses provided by the CTT allows the memorycontroller to provide a set of fast operations to manipulate memory onthe page level granularity. The page operation that is most useful isthe Zero Page Operation which allows for memory zeroing by marking theCTT for a particular real memory page as containing all zeros and allowsthe physical memory associated with that page to be freed and reused.Furthermore, as will be described in greater detail herein, the memorycontroller additionally functions to generate an interrupt when physicalmemory usage exceeds a programmable usage threshold.

The CMS component 50 particularly includes a compressed memorymanagement service module 54 which polls a device driver compressedmemory statistics module 24, gathers compressed memory usage statisticsand, based on these statistics, determines whether or not physicalmemory must be made available. In the case of deterioratingcompressibility and oncoming physical memory exhaustion it will allocatememory from the O/S. Because it is a high priority task, the O/S 75responds by trimming pages of memory from other lower priority tasks inorder to fulfill the request. The pages that are trimmed from the othertasks are written out to the O/S's swap space (not shown) in order topreserve the data contained within them. Upon receiving the memorypages, the CMS will fill them with data that is known to compress into atrivial pattern, i.e., one that compresses to the point of usingvirtually no physical memory. The result is that the physical memorythat was backing the pages is released and may be used elsewhere by thememory controller. The maximum amount of memory that CMS must beprepared to recover is calculated as follows:MaxMemToTakeAway=TR−TP;where “TR” is the Total amount of real memory as seen by the O/S; “TP”is the Total amount of physical memory in the system; and,“MaxMemToTakeAway” is the Total real memory to recover in bytes. It isimportant that the O/S be configured with enough swap file space toaccommodate MaxMemToTakeAway bytes.

The compressed memory controller hardware 80 further generatesinterrupts 81 when physical memory exceeds a programmable thresholdvalue. Using this capability, the memory system is considered to be inone of the following three states at any given time: 1) a SteadyState—where adequate physical memory is available and data iscompressing at least at the boot compression ratio; 2) a WarningState—where physical memory is beginning to run low and correctiveaction should be taken; and 3) an Emergency State—where physical memoryis nearing exhaustion, corrective action must be taken and all otherapplications in the system should be blocked from running until enoughphysical memory is made available to re-enter the Warning or SteadyState.

Aside from polling the memory usage statistics to make corrections, theCMS 50 will receive notifications from the device driver as memory statechanges occur. This allows CMS to take corrective action immediatelyinstead of waiting until it is ready to poll again. As a result, the CMS50 will utilize fewer CPU cycles because memory state changenotifications alleviate the need for polling the compressed memorystatistics module aggressively.

The CMS 50 additionally is included with functionality for spawning ablocker thread 55 (referred to as a “CPU Blocker”) per each CPU in thesystem. This thread remains suspended and awaits a notification from thedevice driver that the physical memory is entering the Emergency State.Once the notification is received the CPU Blocker 55 will monopolize theCPU it is bound to and prevent other applications in the system fromexecuting. Correspondingly, this only allows the CMS 50 and itsassociated tasks to execute. This is necessary because the severity ofthe Emergency State dictates that other applications cannot be allowedto execute as they can further deteriorate the state of the memorysystem.

Device Driver Description

With more particularity, the compressed memory controller hardware 80appears as a peripheral component interconnect (PCI) device andcommunicates with any other device in the system via the compressedmemory device driver 20 which provides a standard set of softwareservices as proscribed by each individual O/S. Application software orO/S software may then communicate with the memory controller hardwareusing the services of the device driver. According to the preferredembodiment of the invention, the device driver 20 provides the followingfacilities: 1) provides various memory compression statistics frommodule 24; 2) from module 26, enables the programming of low physicalmemory threshold registers on the compressed memory controller 80, whichwill initiate generation of an interrupt when the value of the thresholdregister is exceeded; 3) from module 26, broadcasts notification of lowphysical memory interrupts to interested client applications; and, 4)from module 28, provides access to special memory manipulation functionsreferred to as “PageOps” that are unique to the memory compression chip.PageOps are so named because they operate on the typical page size (4K),e.g., as used by the Intel x86 architecture.

The CMS 50 interacts with the device driver 20 by sending device I/Ocontrol code messages to it.

Low Physical Memory Interrupts

The device driver particularly tracks an internal memory state variablebased upon the amount of physical memory in use. The system isconsidered to be in one of three states (Steady, Warning, or Emergency)at any given time. Each memory state has an associated physical memoryusage threshold. A state's threshold is considered to be the transitionpoint between itself and the next memory state. A state's threshold isset by sending a device I/O control code message to the driver. Thefollowing rule concerning thresholds must hold true when thresholdassignments are made:Steady Threshold<Warning Threshold<Emergency Threshold

The driver will initially set the Threshold Low Register (TLR) to thethreshold that exceeds the physical memory used by least amount. Thecurrent memory state is considered to be the state associated with thisthreshold. When the physical memory used grows to exceed the value inthe threshold register, an interrupt will be sent to the device driver.The driver handles the interrupt by re-programming the TLR based uponthe rule described above. Interrupts cause the threshold to be movedhigher. When the current memory state is either Warning or Emergency,the driver will periodically poll to see if the threshold should beadjusted downward. That is, interrupts move the threshold ‘higher’;while polling the memory controller for a reduction in physical memoryusage reduces the threshold (relaxation). The threshold associated withthe Emergency State is used to program the Threshold High Register(THR). If this threshold is exceeded the memory controller will generatea non-maskable interrupt which when received is used to gracefullyshutdown the O/S. Reaching this condition means that physical memory isexhausted and there is only enough left to shut the machine down. Thiscondition is considered a catchall and should not normally be reached.

Memory State Observers

Coupled with the memory state tracking described above, the driverprovides the ability for CMS and other client applications (termedMemory State Observers) to be notified as to memory states changes. Themechanism for notifying applications of events is O/S dependent and isknown to skilled artisans.

Page Operations

As mentioned, the device driver 20 includes a PageOps module 28 thatsupports the ability to access the memory operations on pages ofphysical memory. The key page operation that the driver exposes in termsof compressed memory management is called the Zero Page Operation touser mode applications and is referred to as the Zero Page Op. Theapplication may pass down to the driver a virtual address in its processspace and a length. The driver will convert the address from virtual tophysical and invoke the Zero Page Operation on each page in the range.This page operation has the effect of flushing the page out of the L3Cache (if present), freeing any physical memory in use by the page, andwriting the trivial data pattern (i.e., zero bit pattern) to the page'sCTT entries.

Compression Management Service

The Compression Management Service (CMS) is the user mode portion of thecompressed memory control system. It runs as a background process at apriority level above the normal application execution. For example onWindows 2000 it runs at Real-time priority. This is done so that it maypre-empt other user mode process in the system. At its core is theCompMemMgr component 54 which performs the compressed memory management.

Initialization

During initialization CompMemMgr 54 determines the difference (realmemory size−physical memory size). This result called MaxMemToTakeAwayis the maximum amount of memory that would have to be removed from theVirtual Memory Manager sub-system 77 of the O/S Kernal 75 if anapplication(s) completely fills memory with incompressible data. Memoryis removed from the Virtual Memory Manager 77 via an O/S specific callthat allows an application to allocate memory. For example on Windows2000 it is called VirtualAlloc.

CompMemMgr spawns one or more processes that are called Memory Eaters60. The number of Memory Eaters processes spawned is calculated by thefollowing formula:NumEaters=maximum_of(MaxMemToTakeAway/MaxMemoryAllowerPerProcess,1)

Note that MaxMemoryAllowedPerProcess is dependent upon the O/S beingused.

An interprocess communication (IPC) mechanism is used to allow theCompMemMgr to instruct the Memory Eaters to allocate and release memoryand to also allow the Memory Eaters to provide feedback on theirprogress to the CompMemMgr. Modem O/Ss support many mechanisms to allowprocesses to communicate with each other. For example in implementingthis algorithm for Windows 2000, an area of shared memory is used as themeans of communication.

CompMemMgr determines the physical memory thresholds for the LowPhysical Memory Interrupt. This is done by summing the size of the sizeof the Compression Translation Table (CTT), any memory regions that havebeen setup as uncompressed, size of the resident portion of the O/Skernel, and the size of the L3 cache to back any of the maximum spillover from the L3 cache. After passing the thresholds for each of thememory states down to the driver, it will register itself fornotifications from the device driver as the state of memory systemchanges. These thresholds will be re-calculated by CMS periodically aspart of its memory usage monitoring.

Once the interrupt thresholds have been calculated, theMinConsumptionPhysical value is calculated. This variable represents theamount of physical memory that must be in use for CompMemMgr to performthe calculation that determines whether or not a memory adjustment isnecessary. It is to be placed at a level of physical memory usage, whichis below the point of threshold associated with the Steady State. Theactual calculation is an O/S dependent heuristic but in general it is afactor of how much memory is reserved for the warning and emergencystates. The MinConsumptionPhysical variable calculation serves twopurposes: 1) to get a head start on taking corrective action in advanceof the moving into an elevated memory state; and, 2) to function as awatermark that below which any held memory will be returned to thesystem. It is understood that this value will also be re-calculatedalong with the memory state thresholds.

Next CompMemMgr spawns and binds one CPU Blocker Thread per processor inthe system. As mentioned, the CPU Blockers are utilized when all user(e.g., third-party) applications 65 must be prevented from running.

Finally, the CompMemMgr 54 spawns a thread in which it executes thecompressed memory management algorithm depicted in FIGS. 2( a)-2(b).

Managing Compressed Memory

FIGS. 2( a)-2(b) is a block diagram illustrating the compressed memorymanagement algorithm.

FIG. 2( a) particularly depicts the main loop 100 of the compressedmemory management algorithm which is a loop executed by the CompMemMgrfor waiting on one of the memory state notification events from thedriver, the terminate event, or a wait timeout value. In a first step110, the variables WaitTimeOut and TotalMemConsumed are initialized.Particularly, the variable WaitTimeOut is a constant value that isoperating system independent and represents a polling interval which isset a default value DEFAULT_SLEEP_TIMEOUT, and may range anywherebetween 0 to 1000 msec., for example. As memory pressure increasesdriving the system into warning and emergency state, the rate of pollingis increased. Thus, a WaitTimeOut value of 0 msec means that aWaitForMemoryStateChangeSignalFromDriver function will check for anyevents being triggered (i.e., a memory state change signal from thedriver) and will return immediately. Conversely, when WaitTimeOut is1000 msec, the WaitForStateChangeSignalFromDriver function will wait fora maximum of a second before returning from the function call so as toyield the processor to other tasks. The variable initialTotalMemConsumed is the memory consumed, and is initially set to zero(0). Then, at step 115, the process waits for a state change signal(interrupt) from the device driver, and sets a variable RESULT equal tothe state change value, i.e.,WaitForMemoryStateChangeSignalFromDriver(WaitTimeOut). Next, at step120, a decision is made as to whether a notification event (statechange) has been received from the driver. If no state change hasoccurred, i.e., then the process proceeds to step 150 where the processis invoked for obtaining updated statistics and performing any memoryusage correction calculations as described with respect to FIG. 2( b).If there is a state change, a determination is made at step 125 as towhether the change is a terminate event. If the event received is aterminate event, then the process exits at step 130. If a state changehas occurred and it was not a terminate event, then the process proceedsto step 140 where the current memory state value is set to the result.The step 150 of gathering of memory usage statistics is then performedand the process repeats by returning to step 110. As will be explainedin greater detail, memory usage statistics come from three sources: theDevice Driver, the O/S, and randomly selected memory page sampling.

A C++-like pseudocode depiction of the process exemplified by FIG. 2( a)is now provided:

void ManageCompressedMemory( ) { unsigned long WaitTimeOut =DEFAULT_SLEEP_TIMEOUT; MEMUNITS TotalMemConsumed = 0; while (1) { Result= WaitForMemoryStateChangeSignalFromDriver(WaitTimeOut); if (Result !=NO_STATE_CHANGE) { switch (Signaled) { case TERMINATE: return 0; caseEMERGENCY: WaitTimeOut = 0; CurrMemState = EmergencyState; break; caseWARNING: WaitTimeOut = 0; CurrMemState = WarningState; break; caseSTEADY: WaitTimeOut = DEFAULT_SLEEP_TIMEOUT; CurrMemState = SteadyState;break; default: continue; } }

FIG. 2( b) particularly depicts the make memory usage correctionsprocess 150 as shown in FIG. 2( a). In the memory usage correctionsprocess loop 150, a first step 155 involves gathering the memory status,i.e., the memory statistics. Then, at step 160, the current real memory(CurrRealUsed) used is computed in accordance with the statisticsprovided by the device driver. Then, at step 165, the current physicalmemory (CurrPhysUsed) used is computed. This value includes the size ofthe physical memory usage plus the size of the Compression TranslationTable (CTT) (CTTLength), the size of any defined uncompressed memoryregions, and the size of the NonSwappablePages (SizeOfNonSwapPages).Typically the uncompressed memory region is 1 MB and is setup by theBIOS. This is necessary because the physical memory usage reported bythe compressed memory controller chip does not account for these values.At the next step 170, an evaluation is made as to whether the currentmemory state (determined in the main loop 100 of the compressed memorymanagement algorithm) is the steady state AND that the current physicalmemory computed in step 165 is less than usage is below a minimum usagewater mark (MinConsumptionPhysical). If at step 170, it is determinedthat the current memory state is the Steady State AND the currentphysical memory computed in step 165 is not less than a minimumthreshold, then the process proceeds to step 175 to compute a targetedreal memory usage (TargetedRealUsage) representing how the size ofmemory is to be adjusted. That is, a variable TargetedRealMemoryUse iscalculated by multiplying the amount of physical memory in use by theboot compression ratio. To determine the memory adjustment needed, theactual amount of real memory in use plus the total amount of memoryalready held by the Memory Eaters is subtracted from theTargetedRealMemoryUse. This is the variable AdjustmentReal. A negativeresult means that the compressibility of the system is equal to orgreater than the boot compression ratio. This means that the MemoryEaters should release AdjustmentReal units of memory back to the system.Particularly, based on the amount of physical memory in use, acalculation is made as to how much real memory should be in use which isequal to the boot compression ration of the memory system multiplied bythe current physical memory used CurrPhysUsed calculated at step 165.Then at step 180, a value for the real memory adjustment(AdjustmentReal) is computed as being equal to the TargetedRealUsageminus a quantity comprising the CurrRealUsed plus the TotalMemConsumed.Then, at step 182, a determination is made as to whetherAdjustmentReal<0. If AdjustmentReal is less than 0, then the processproceeds to step 185 where the AdjustmentReal variable is set equal tomax_of(AdjustmentReal, TotalMemConsumed). This is to ensure that thereis released only as much available. Particularly, it is desired torelease memory slower than it is acquired in case conditions quicklydeteriorate. A release ratefactor may be applied to the amount that willbe released in any one iteration of memory adjustment.

Returning to step 182, if it is determined that AdjustmentReal isgreater than or equal to 0, then the Memory Eaters must allocateAdjustment Units of memory. In doing so the Memory Eater calls the O/S'smemory allocation facility for the required memory. The Memory Eaterthen passes a pointer to the memory its length to the device driver toperform a Zero Page Operation on the all the pages the area contains.These steps are depicted from steps 188, 190, 192 and 195. Particularly,at step 188, the AdjustmentReal variable is set equal tomin_of(AdjustmentReal, the quantity MaxMemToTakeAway−TotalMemConsumed)where MaxMemToTakeAway is the total real memory to recover in bytes asdefined herein. This calculation is made to ensure that the requestedadjustment lies within the bounds of what the memory eaters can eat. Forexample, if MaxMemToTakeAway is 100 Mbytes, AdjustmentReal is 100Mbytes, and the TotalMemConsumed (the amount that the eaters are alreadyholding) is 25 Mbytes, then the eaters can only hold another 75 Mbytes,i.e., Adjustment is min_of(100, 100−25)=75 Mbytes. Next, at step 190,the Memory Eaters are put to work by writing the adjustment value intothe shared memory block via the monitor. The internal statistics arethen updated at steps 192, 195.

A C++-like pseudocode depiction of the process exemplified by FIG. 2( b)is now provided:

// Get current memory statistics. GetMemoryStatus(Stats); MEMUNITSCurrRealUsed = Stats.UsedReal; MEMUNITS CurrPhysUsed =Stats.UsedPhysical; // Add onto the physical memory usage the size ofthe CTT, // the size of the uncompressed region, and the size of // theNonSwappablePages. CurrPhysUsed = CTTLength + UncompressedRegion +Stats.SizeOfNonSwapPages; // As long as the system is in memory stateand the physical // memory usage is below the minimum usage water mark// release all the memory held by the memory eaters. if ((CurrMemState== SteadyState) && (CurrPhysUsed < MinConsumptionPhysical)) { // Releaseall the memory held by the eaters. // Except for any guaranteed AWEregions on W2K. AdjustmentReal = m_TotalMemConsumed;; if (AdjustmentReal< 0) AdjustmentReal = 0; else AdjustmentReal = −AdjustmentReal; } else {// Calculate how the size of memory is to be adjusted. // Based on theamount of physical memory in use // calculate how much real memoryshould be in use. MEMUNITS TargetedRealUsage =static_cast<MEMUNITS>(m_BootCompRatio * CurrPhysUsed); AdjustmentReal =TargetedRealUsage − (CurrRealUsed + TotalMemConsumed); if(AdjustmentReal < 0) { // Releasing memory. // Want to release memoryslower than it is // acquired in case conditions quickly // deteriorate.Apply a release rate factor to // the amount that will be released inany one // iteration of memory adjustment. MEMUNITS RateAdjusted =AdjustmentReal / MemReleaseRate; if (0 == RateAdjusted) { RateAdjusted =AdjustmentReal; } // Make sure to release only as much as we have.AdjustmentReal = max(RateAdjusted, −TotalMemConsumed); } else { //Consuming memory. AdjustmentReal = min(MaxMemToTakeAway −TotalMemConsumed, AdjustmentReal); } } // Put the eaters to work bywriting the adjustment value // into the shared memory block via themonitor. NotifyMemoryEaters(AdjustmentReal); If(ReCalculateMemoryStateThresholds( )) SetMemoryStateThresholds( ); //Update our internal stats. TotalMemConsumed += AdjustmentReal; } }Warning and Emergency States

If CompMemMgr is notified of the Warning or Emergency state beingentered, it will switch the timeout for the next iteration to 0. This isdone so that as much CPU time as possible may be spent on CompMemMgranalyzing memory conditions and on the Memory Eaters compensating forthe memory condition. Recall that there is also one CPU Blocker threadper processor waiting on a signal from the driver indicating that thememory usage has moved into the Emergency State. Once the CPU Blocker isnotified of the Emergency condition it will hog the CPU it is bound to.This has the effect of blocking all other user applications from runningwhich is necessary because once the system enters the Emergency State itis getting very close to running out of physical memory. Allowing userapplications to run might further deteriorate memory conditions causingthe machine to stop running. The CPU Blocker runs at the priority leveljust below CompMemMgr and the Memory Eaters. This allows the compressedmemory management to pre-empt the blocker threads but also allow theblocker threads to block other user mode applications. The CPU Blockerthreads will stop “hogging” the CPU when it is signaled that the memorysystem has moved back into the Steady or Warning State. It is then safeto allow other applications to continue running.

Adjusting Priorities

The O/S itself has threads that run at high priority normal or higher.These threads are not problematic for the compression controls becausethey run for very short durations and cannot change the overallcompressibility of the system. However, it is possible for otherapplications to be run at priority levels which are higher than thecompression controls for long durations, which in theory can beproblematic for the compression controls. It should be noted thatapplications running at these priority levels do not yield the CPU couldinterfere with the normal operation of the Virtual Memory Manager itselfand cause the O/S to behave erratically. One way to avoid having theseapplications interfere with the compression control software is to havethe controls dynamically lower the process priority (or suspend theprocess entirely) while in the Emergency State. The priority may berestored after the crisis has been rectified.

While the invention has been particularly shown and described withrespect to illustrative and preformed embodiments thereof, it will beunderstood by those skilled in the art that the foregoing and otherchanges in form and details may be made therein without departing fromthe spirit and scope of the invention which should be limited only bythe scope of the appended claims.

1. A system for managing real memory usage in a computer device havingan operating system (O/S) and a compressed main memory defining aphysical memory and a real memory characterized as a fixed amount ofmain memory as seen by a processor, and, a compressed memory hardwarecontroller device for controlling processor access to said compressedmain memory, said system comprising: a compressed memory device driverfor receiving real memory usage information from said compressed memoryhardware controller, said information including a characterization of atleast one real memory usage state; a compression management meansexecuting as an application in non-O/S kernel mode as a backgroundprocess at a real-time priority level for monitoring said real memoryusage information, and in response to receiving notification of a realmemory usage state change one of initiating memory allocation orrecovery within an operating system memory space including the freeingup of physical memory from the operating system by swapping out pages ofmemory associated with lower priority tasks when physical memoryavailability is below said at least one memory usage state threshold,and, the recovery of physical memory to the operating system such thatthere always is enough physical memory in which to include applicationand O/S data, said compression management means including a mechanismfor adjusting said memory usage thresholds for controlling memory usagestate changes, whereby control of said real memory usage in saidcomputer system is accomplished without modification to an operatingsystem kernel and transparent to said operating system.
 2. The systemfor managing real memory usage as claimed in claim 1, wherein said realmemory usage information includes memory compression statistics.
 3. Thesystem for managing real memory usage as claimed in claim 1, whereinsaid memory controller hardware includes an interrupt generatormechanism for generating an interrupt indicating memory usage exceedinga physical real memory usage threshold, said characterization of saidreal memory usage including a memory state set according to an amount ofphysical memory used.
 4. The system for managing real memory usage asclaimed in claim 3, wherein said compressed memory device driver furtherincludes mechanism responsive to said interrupt for broadcasting lowphysical memory usage interrupts to client applications running on saidcomputer system.
 5. The system for managing real memory usage as claimedin claim 3, wherein said memory controller hardware includes one or morethreshold registers associated with a physical memory usage threshold,said interrupt being generated when a usage threshold value is exceeded.6. The system for managing real memory usage as claimed in claim 5,wherein said compressed memory device driver further includes mechanismresponsive to said interrupt for adjusting said physical memory usagethreshold value in accordance with a current memory usage state.
 7. Thesystem for managing real memory usage as claimed in claim 5, whereinsaid at least one memory state includes one of a steady state, warningstate and emergency state according to said thresholds, said devicedriver including polling mechanism for polling said memory controllerand determining if a threshold should be readjusted downward when insaid warning state and emergency state.
 8. The system for managing realmemory usage as claimed in claim 5, wherein each said memory usagethreshold is programmable by said compression management means, saidcompressed memory device driver comprising an interface to said memorycontroller hardware for setting a memory usage threshold.
 9. The systemfor managing real memory usage as claimed in claim 5, wherein a currentmemory usage threshold value includes a value associated with each saidat least one memory state including one of a steady state, warning stateand emergency state, wherein said threshold values for each state aregoverned according to:steady state threshold<warning threshold<emergency threshold.
 10. Thesystem for managing real memory usage as claimed in claim 9, whereinsaid compression management subsystem includes mechanism for generatingone or more blocker processes for association with a single processoroperating in said system, each blocker process binding to an associatedprocessor and monopolizing processor time to prevent other applicationsrunning in said system from executing when memory usage exceeds saidemergency state threshold.
 11. The system for managing real memory usageas claimed in claim 9, wherein said compression management subsystemincludes mechanism for generating one or more memory eater processes forperforming one of: allocating to or releasing said memory from withinthe operating system.
 12. The system for managing real memory usage asclaimed in claim 11, wherein a memory eater process takes away physicalmemory from the system and replace the data in virtual pages of memorywith a highly compressible data, thereby controlling averagecompressibility of all real memory.
 13. The system for managing realmemory usage as claimed in claim 11, wherein a number of memory eaterprocesses generated is dependent upon a total real memory amount torecover from said system.
 14. The system for managing real memory usageas claimed in claim 13, wherein said total real memory amount to recoverfrom said system is equal to a quantity representing a differencebetween a total amount of real memory as seen by the operating systemand a total amount of physical memory in the system.
 15. The system formanaging real memory usage as claimed in claim 11, wherein saidcompression management subsystem includes mechanism for determining anadjustment amount comprising the amount of physical memory that needs tobe allocated or released, said adjustment amount based on a bootcompression ratio of said system.
 16. The system for managing realmemory usage as claimed in claim 15, wherein said compression managementsubsystem includes mechanism for allocating one or more pages of memoryat a time.